
WATERMARK RESISTANT TO ROTATION AND RESIZING 
BACKGROUND OF THE INVENTION 

[0001] This invention relates to watermarks that form part of 
the content on computer readable memory media. More 
particularly, this invention relates to memory media having 
watermarks and methods of creating and detecting such watermarks. 

[0002] It is of great concern to the music, video, software 

and publishing industries to be able to prevent and track 
improper copying of content from computer readable memory media 

(e.g., digital video disks (DVDs), compact disks (CDs), read only 
memory (ROM) , random access memory (RAM) , various magnetic media 
and other memory media) . This concern has been addressed, in 
part, by the use of "watermarks," which are hidden messages 
arranged on a memory medium along with other data, such as video 
data, audio data, various software applications, etc. 

[0003] For example, watermarks have been used on optical 

memory media, such as CD-ROMs and DVDs to prevent the undesired 
copying of music, movies and software. Notwithstanding such 
efforts, commercial pirates have used professional editing 
equipment to erase, obfuscate or otherwise bypass watermarks so 
that the desired content can be copied from the media on which 
the content is stored. 

[0004] One way that pirates have bypassed existing watermark 

protection systems with optical media having digital data 
embedded thereon, such as CD-ROMs and DVDs, is through the use of 
editing and copying equipment that geometrically modifies the 
configuration (e.g., orientation, shape or size) of the digital 
content including the watermark in such a way as to render the 
watermark unreadable. Such geometric modification has been 
accomplished in many different ways including rotation, resizing, 
cropping, warping, mirroring, etc. 

[0005] More specifically, with respect to digital video data 
embedded on a DVD or the like, the data is arranged in numerous 
consecutive video frames. Prior art watermarks that carried a 
"do not copy" message were arranged in one or more of the video 
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frames to prevent unauthorized and undesired copying. However, 
consumer and professional playback, editing and copying equipment 
can be used to rotate and resize of the video data. The resizing 
factor and the rotation angle can vary over continuous ranges. 
[0006] In the case where editing equipment is used to slightly 
rotate or resize the video data, the watermark in each frame is 
similarly rotated or resized. A data detector, such as a 
standard correlation detector or matched filter, has been used to 
detect the presence of any watermark pattern in each frame of 
video data. When the frames are rotated or resized, even a very 
small amount, the correlation detector often cannot properly 
detect the presence of a pattern within the watermark and thus 
the content, of the watermark message cannot be read. This 
occurs because prior art correlation detectors are particularly 
dependent upon specific registration of the digital data patterns 
of the watermark within each video frame. Thus, a slight 
modification of the resizing factor or rotation angle, can cause 
the failure of a correlation detector to detect the pattern and 
thus, the specific "do not copy" message of the watermark. The 
content on the DVD or other optical memory media could then be 
copied . 

[0007] Attempts have been made to create robust watermarks 
that are resistant to efforts by pirates to overcome such 
watermarks and copy the accompanying data . Some of these 
attempts involve the use of log-polar coordinates and Fourier and 
Mellin transforms for image processing and registration. Data 
can be converted from normal Cartesian coordinates to log-polar 
coordinates through a known algorithm, which typically requires 
coordinate transformation from normal Cartesian coordinates (x, 
y) to polar coordinates (R, 6) and then to log-polar coordinates 
(L, 0) by taking the log of the radius after the coordinates have 
been converted from Cartesian to polar. 

[0008] Unfortunately, these existing watermarking systems have 
various drawbacks. First, they require that the watermark be 
embedded in a particular transform domain for it to be resistant 
to geometric transformations. This limits the flexibility in the 
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design of the watermark, and so these techniques cannot be 
incorporated into a previously designed watermarking system to 
improve it . 

[0009] Second, these watermarking systems have been criticized 

for being robust to geometric transformations, but not to other 
attacks such as noise addition. The technical reason is that 
these systems obtain geometric robustness by embedding the 
watermark in the magnitude of a Fourier transform. This 
transform magnitude is invariant to spatial shifts in the input 
to the transform, but it is easy to modify and attack. On the 
other hand, it is well known in image processing that the phase 
of the Fourier transform of an image contains most of the 
information in the image. It is possible to completely change 
the magnitude of the transform, inverse transform the magnitude 
and phase, and still see much of the content of the original 
image . 

[0010] Other approaches embed simple patterns, or complete 

watermarks, at known positions in images or video frames, and 
then detect these patterns or watermarks and their positions to 
compute and account for any rotation, resizing, or other 
geometric alteration. A system that uses these approaches may 
not require any frequency transforms or log-polar mappings. 
Thus, the general idea appears attractive. Also, helper patterns 
or watermarks can be added to a pre-existing watermark, as long 
as they do not interfere. In this way, geometric robustness can 
be added to a pre-existing watermark system. 

[0011] Unfortunately, such approaches also have drawbacks. 
For example, there is a tradeoff between robustness and ease of 
detection of the helper patterns or watermarks. A simple helper 
pattern may be easy to detect even after it has been 
geometrically altered -- this makes geometric robustness for the 
main watermark easy to attain, but also makes the helper pattern 
easy to find and attack. Then, the robustness of the main 
watermark to geometric manipulations is defeated. On the other 
hand, the helper patterns may actually be watermarks, which are 
harder to remove, but also much harder to detect. If the helper 
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watermarks are arbitrary, exhaustive searches may be required 
over some geometric parameters (such as the angle of rotation) . 
In a sense, such systems merely shift the problem of robustness 
from the parent watermark to the helper patterns or watermarks. 
[0012] The present invention overcomes the drawbacks of the 
foregoing watermark systems by providing a watermark that is 
resistant to efforts by pirates to avoid "do not copy, " or other 
messages, of hidden watermarks through techniques such as 
rotation, resizing or other modification efforts of the protected 
content . 

SUMMARY OF THE INVENTION 

[0013] In accordance with a first aspect of the present 

invention, computer readable memory medium is provided. The 
memory medium may be an optical medium, magnetic medium, ROM, RAM 
or any other computer readable storage device. The memory medium 
comprises video or audio data arranged in a plurality of frames, 
and a hidden digital watermark arranged in at least one of the 
plurality of frames. The hidden watermark includes a first 
preselected pattern of data and a second preselected pattern of 
data arranged within at least one of the frames. The first 
preselected pattern includes information indicative of the 
geometric orientation of the second preselected pattern and the 
video or audio data within the frames. The second preselected 
pattern includes information indicative of a desired message. 
The first and second preselected patterns are substantially 
hidden when the video or audio data is displayed or played on an 
associated display screen or player. 

[0014] Preferably, the first preselected pattern of data is 

arranged at a central portion of the at least one frame on the 
computer readable memory medium. It is also preferable for the 
second preselected pattern of data to be arranged on the same 
frame or frames as the first preselected pattern of data. The 
second preselected pattern of data is preferably arranged at 
portions other than the central portion of the at least one 
frame . 
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[0015] In a preferred embodiment, the computer readable memory 

medium comprises an optical medium. The optical medium may 
comprise a DVD, a CD-ROM, or any other storage device that can be 
optically read by an associated computer or other detecting 
device . 

[0016] It should be understood that as used herein, the term 

"geometric configuration" is intended to cover information of a 
certain orientation, shape and/or size. The "geometric 

configuration" may relate only to one of the specific 
orientation, shape or size of data and associated information. 
Alternatively, the "geometric configuration" may relate to the 
combination of orientation, shape and size of data and associated 
information . 

[0017] As used herein, the term "video or audio data" is 
intended to cover all types of data content including still image 
data, true video data such as that used in movies, other types of 
graphics data, text data, sound data, etc. 

[0018] The first preselected pattern of data may comprise 

reference size information, whereby an associated watermark 
detecting device can detect the actual size of the first 
preselected pattern of data and can thereafter determine a 
resizing factor based upon any deviation between the actual and 
reference sizes thereof . The second preselected pattern of data 
is preferably arranged within frames on the memory medium at 
portions other than the central portions thereof where the first 
preselected pattern is arranged. 

[0019] Preferably, the first and second preselected patterns 

of data comprise digital data. The digital data of the first and 
second preselected patterns may be arranged within frames on the 
memory medium along with video and audio data. 

[0020] The desired message of the second preselected pattern 

of data may comprise a "do not copy" message. Additional or 
other messages may also be provided by the second preselected 
pattern of data. 

[0021] It is preferable for the hidden digital watermark to be 

arranged in a plurality of successive video frames. In this 


5 



regard, a complete "do not copy" message may be transmitted over 
"n" consecutive video frames, and the message of the hidden 
digital watermark may repeat every "n" frames. 

[0022] It is preferable for the first preselected pattern of 

data to comprise a design suitable to be converted to log-polar 
coordinates that will convey information to an associated 
correlation detector about the orientation and/or relative size 
of the second preselected pattern of data. 

[0023] In accordance with a second aspect of the present 

invention, a method of detecting a hidden digital watermark 
message ■ embedded on a computer readable memory medium is 
provided. The hidden digital watermark message preferably 
comprises first and second patterns of digital data embedded 
along with video or audio data within at least one video frame of 
the memory medium. The method comprises the steps of detecting 
the first preselected pattern of data; determining the geometric 
configuration of the first preselected pattern of data; comparing 
the actual geometric configuration of the first preselected 
pattern of data with reference geometric configuration 
information thereof stored in memory associated with a watermark 
detector; calculating any deviation between the actual geometric 
configuration of the first preselected pattern of data and the 
reference geometric configuration information thereof; and 
utilizing any calculated deviation between the actual and 
reference geometric configurations of the first preselected 
pattern of data to detect a second preselected pattern of data. 

[0024] It is preferable for the actual and reference geometric 

configuration information to relate to the relative position and 
size of the second preselected pattern of data and the video or 
audio data within the same frames. 

[0025] It is also preferable for the first preselected pattern 

of data to be arranged at a central portion of the frames. The 
second preselected pattern of data may be arranged within the 
same frames as the first preselected pattern of data at portions 
other than the central portion thereof. In this preferred 
embodiment, the step of detecting the first preselected pattern 
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of data comprises locating the central portion of the frame 
containing the data. 

[0026] The message of the second preselected pattern is 

preferably a "do not copy. " The information conveyed by the 
first preselected pattern of data preferably relates to at least 
one of the orientation and relative size of the second 
preselected pattern of data. 

[0027] The reference geometric configuration information may 
comprise stored log-polar coordinate information. If such 

information is present, the method of detecting a hidden 
watermark message may comprise the steps of (1) converting data 
corresponding to the actual geometric configuration of the first 
preselected pattern of data into log-polar coordinates, and (2) 
comparing any deviation in the log-polar coordinates of the 
actual and reference geometric configuration information to 
determine a rotation angle or resizing factor, whereby (3) the 
rotation angle or resizing factor is utilized to detect the 
desired message of the second predetermined pattern of data. 

[0028] In a preferred embodiment where the computer readable 

memory medium comprises an optical medium, all data thereon may 
comprise digital data. The steps of the method of detecting a 
hidden watermark may comprise optically detecting all data on the 
optical medium. 

[0029] In yet another aspect of the present invention, a 

method of creating a hidden watermark message within video or 
audio data on a computer readable memory medium is provided. The 
method comprises the steps of embedding a first preselected 
pattern of data within at lease one frame of data on the memory 
medium; and embedding a second preselected pattern of data within 
the at least one frame of data. The first preselected pattern 
preferably includes information indicative of the geometric 
configuration of said second preselected pattern of data and said 
video or audio data. The second preselected pattern of data 
preferably includes information indicative of a desired message. 
The first and second preselected patterns are preferably 
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substantially hidden when this video or audio data is displayed or 
played . 

[0030] Preferably, the first preselected pattern of data is 

embedded on the memory medium at a central portion of the at 
least one frame. The computer readable memory medium may 
comprise an optical medium such as a DVD, CD-ROM or other optical 
medium. However, any computer readable memory medium may be used 
in accordance with this aspect of the present invention. 
[0031] In the preferred embodiment where the first preselected 

pattern of data is embedded at a central portion of the at least 
one frame, it is preferable for the second preselected pattern of 
data to be embedded within the same frames at portions other than 
the central portion thereof. 

[0032] The desired message of the second preselected pattern 
of data is preferably a do not copy message. However, an 
infinite variety of messages may be provided in alternate 
embodiments . 

[0033] It is preferable for the first preselected pattern of 

data to comprise a design that can be converted into log-polar 
coordinates. The geometric configuration information carried by 
the first preselected pattern of data preferably comprises at 
least one of position and size information. In this embodiment, 
an associated watermark detection device can determine at least 
one of the actual position and size of the first preselected 
pattern of data and compare such actual position and size with 
reference to position and size information stored in memory. The 
deviation between the actual and reference position and size 
information is then calculated, and is used to determine at least 
one of a resizing and rotation factor, which in turn is used to 
detect the desired message of the second preselected pattern of 
data . 

[0034] The foregoing features of the present invention may be 
further appreciated with reference to the following description 
of the preferred embodiment and accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0035] Fig. 1 is a schematic illustration of the watermark of 

the present invention . 

[0036] Fig. 2 is a schematic illustration of a frame of data 
having a prior art watermark embedded therein. 

[0037] Fig. 3 is a schematic illustration of the frame of data 
of Fig. 2 showing the watermark before and after being rotated. 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0038] The watermark of the present invention may be displayed 
in any of an infinite variety of designs. A preferred watermark 
system may use a checkerboard design, such as that developed by 
Sony Corporation of Tokyo, Japan. 

[003 9] The watermark carries a hidden message embedded in each 
frame or selected frames of data on a computer readable memory 
medium. Although this preferred embodiment will be described in 
the context of a digital watermark embedded in frames of video 
data on an optical medium, such as a DVD, it should be 
appreciated that the present invention applies to all computer 
readable memory media, and is not limited to digital data or any 
particular type of video or audio data. 

[0040] In the preexisting preferred Sony watermark " system, 

there are numerous different checkerboard patterns that can 
convey many different messages. Each black and white square of 
the checkerboard watermark corresponds to a digital 1 or 0 . The 
message may be disbursed over a series of frames, as opposed to 
being placed in its entirety in a single frame. When the 
watermark is used to provide a "do not copy" message for a movie, 
it may be placed in one or all of the frames of video data. The 
entire movie includes numerous successive frames. The "do not 
copy" message may be transmitted and repeated every "n" frames 
throughout a series of "n" checkerboard patterns. Each video 
frame may include a portion of the watermark. Thus, while the 
checkerboard pattern of the watermark system may vary from frame 
to frame, the "family" of the checkerboard pattern will remain 
the same throughout a certain number of successive video frames . 
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[0041] The present invention relates to a watermark that is 
immune to various geometric alterations such as rotation and 
resizing. In other words, a correlation kernel, or the like, of 
the watermark will be detected by a correlation detector, or the 
like, of an editing, copying or playing machine (hereinafter 
collectively a "player") despite any effort to rotate, resize or 
otherwise alter the geometric configuration of the watermark. 
The hidden message of the watermark could then be read and 
processed. In the context of DVDs, an associated DVD player will 
be able to read the copy control message of the watermark 
regardless of a pirate's efforts to rotate or resize the video 
frames . 

[0042] The heart of the invention relates to a watermark that 

comprises two portions. The first portion includes a first 
preselected pattern of data and a second portion includes a 
second preselected pattern of data. At least part of the first 
portion of data is placed in the center of each frame. However, 
this portion of the watermark includes bits of data or other 
information arranged in a pattern that is asymmetrical with 
respect to the center of the frame. The centrally arranged 
watermark pattern (i.e., the first preselected pattern) is used 
to provide information about the geometric configuration, such as 
the orientation and/or size of the second portion of the 
watermark and the video data within the video frame. It 
comprises a pattern that cannot be mapped onto itself under any 
nontrivial combination of rotation and resizing. This means that 
any combination of rotation and resizing of the centrally 
arranged watermark pattern (i.e., the first pre-selected pattern) 
will produce a unique variation of the pattern, from which the 
rotation angle and resizing factor can be computed. Also, this 
centrally located pattern carries no copy control message, and is 
independent of the second pre-selected pattern. Because of these 
properties, only a single centrally located pattern need be used 
to allow a processor of an associated player to perform both the 
rotation and resizing calculations as described below. 
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[0043] The second portion of the watermark pattern includes a 
copy control message, or other desired message. The second 
portion may be repetitively placed around the rest of each video 
frame, (i.e., in all portions of the video frame excluding the 
central portion). Thus, the present invention relates to a 
watermark having the following two parts in each frame of video 
or audio data: 

1. A central portion -- used to convey a message 
regarding the geometric configuration of the 
hidden message of the second portion of the 
watermark; and 

2 . A second portion arranged in the same video 
frame as the central portion -- used to convey the 
copy control message or other message. 
[0044] A schematic illustration of a watermark in accordance 
with the present invention is shown in Fig. 1. The watermark 10 
includes a first portion 12 having a generally circular 
configuration with a first preselected pattern of data. The 
watermark 10 also includes a second portion 14 having a second 
preselected pattern of data in the form of a checkerboard. The 
watermark 10 is placed within a frame 18 of video or audio data 
on an associated optical medium, such as a DVD (not shown) . 
[0045] In a preferred embodiment, the message carried by the 

pattern of the second portion 14 of the watermark 10 is a "do not 
copy" message. However, it should be understood that an infinite 
variety of messages could be carried by the second portion 14 to 
be detected and read by an associated correlation detector and 
reader of a player. 

[0046] As shown in Fig. 1, the first portion 12 of the 

watermark 10 includes a pattern, which is not completely 
symmetrical. The first portion 12 is arranged in the center of a 
video frame. Although the particular video data that is arranged 
within the video frame 18 to be displayed on the associated 
display screen is not shown in the drawings, it should be 
understood that the watermark 10 is preferably superimposed on 
various portions of the video image in such a way as to be 
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substantially hidden from a viewer's eye when the video image is 
displayed on a television or other display screen. The video 
data is not shown in the drawings so that the features of the 
present invention can be emphasized. 

[0047] The first portion 12 including a first preselected 
pattern of data is arranged at the center of the video frame 18. 
As the first portion 12 is the portion to be registered with and 
detected by a correlation detector of a player (not shown) it may 
be considered to be the correlation kernel of the watermark 10. 
The correlation detector will always be able to detect it based 
on its central location and its log-polar coordinates after 
conversion of its Cartesian coordinates (discussed further 
below) . After the first portion 12 is detected, the player will 
be able to calculate the necessary geometric information 
regarding the actual orientation, size, etc., of the first 
preselected pattern. The player includes memory associated with 
the correlation detector that stores reference geometric 
configuration information about the first and second preselected 
patterns 12 and 14 of the watermark 10. The actual geometric 
configuration information will be compared to the reference 
geometric configuration information and any deviation 
therebetween will then be determined. 

[0048] In the event that an editing operation, such as 

rotation or resizing is attempted on a video frame 18 of an 
associated DVD (not shown) , the calculated deviation between the 
actual and reference geometric configuration of the first portion 
12 of the watermark 10 will then be used to calculate the degree 
of rotation and thus the rotation angle as well as the resizing 
factor. The rotation angle and resizing factor are then used to 
precisely locate the rotated and/or resized second portion 14 of 
the watermark 10 so that the message thereof, such as a "do not 
copy" message, is conveyed to the player. Thus, unauthorized 
copying of the video and audio data from the DVD is prevented. 

[0049] The content of the second portion 14 of the watermark 
10 is preferably arranged throughout the associated video 
frame 18, at portions other than the center thereof where the 
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first portion 12 is arranged. The second portion 14 may have a 
patterned design consistent with any known watermark, such as the 
preferred Sony checkerboard watermark, or it may have a new 
pattern not previously implemented in existing watermarks. 
[0050] The calculation of any difference between the stored 
reference orientation of the preselected pattern of the first 
portion 12 of the watermark 10 and the actual location thereof, 
may be done by known estimation techniques or by actual measured 
calculations or algorithms. Thus, as used herein, the term 
"calculation" is intended to cover both actual and estimated 
determinations . 

[0051] Fig. 2 schematically illustrates a prior art watermark 
30 within a frame of video data 38. A correlation kernel 32 that 
is used for the detection and reading of the watermark is also 
shown in Fig. 2. 

[0052] Fig. 3 illustrates a frame of video data 38 having a 

prior art watermark 30 therein, before and after it is subjected 
to a rotation operation. As evident from Fig. 3, the correlation 
kernel 32 of the watermark 3 0 is rotated along with the video 
data within frame 3 8 and the watermark 3 0 therein. When a 
correlation detector (not shown) of an associated player looks 
for the correlation kernel 32, it would only find it along with 
the message of the hidden watermark 30 in situations where the 
watermark 30 is not rotated along with the entire video frame 38. 
However, in a situation where rotation has occurred, the 
correlation detector of an associated player will not precisely 
match up with the correlation kernel 32 of the watermark 30. 
Thus, the hidden message carried by the watermark 3 0 will not be 
read by an associated player. A similar problem exists when 
resizing occurs. That is, the correlation kernel 32 is enlarged 
such that it does not precisely register with the correlation 
detector of an associated player. Once again, the message 
carried by the watermark 10 cannot be read. 

[0053] The watermark 10 of the present invention is immune to 

the problem of rotation and resizing, because the centrally 
arranged first portion 12 will always be detected. The basic 
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reason is that both the design of the pattern and the detector 
for this pattern use log-polar coordinates. 

[0054] In order to understand this aspect of the invention, it 

is helpful to understand the operation of a conventional 
correlation detector, which may be used to detect the presence of 
a pattern in an image. This pattern may include a particular 
arrangement of pixel values over the whole image or a sub- region 
of the image. One approach would be to search for this pattern 
in the image. However, if the pattern is used to design a linear 
filter, it can be detected, even in the presence of noise or 
interference from details in the image. The pixel values in the 
pattern are treated as a set of filter coefficients (or kernel) 
for a linear filter. Then: 

1) Superimpose the kernel on a position in an image; 

2) Multiply each image pixel by the corresponding coefficient 
from the kernel (i.e. the value from the pattern to be 
detected) ; 

3) Sum the collection of products from step 2; and 

4) If the sum from step 3 has a large magnitude, then it can be 
determined that the pattern is present at the particular 
position. Otherwise, it is not present. 

[0055] Essentially, the correlation detector strongly reacts 

to any instance of the pattern in the image, but weakly to 
anything sufficiently unrelated to that pattern. At a position 
of an instance of the pattern, the output of the filter is 
approximately the mean- square energy in the pattern times the 
sign of the embedded pattern. The energy will vary if the 
amplitude of the embedded instance of the pattern is different 
from the amplitude of the pattern in the filter kernel. The sign 
of the filter output will be negative if the values in the 
embedded instance were inverted before being added to the image. 
[0056] In a simple watermark system, a known pattern is added 

at a known position in an image or video frame, and a correlation 
detector is used to detect it. The pattern is added at a low 
level so as to be (almost) invisible. It is chosen to be 
apparently random or noise-like. This has two benefits: first, 
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if it is visible, it appears as noise; second, the probability of 
a precisely similar pattern occurring in an image or video frame 
is extremely small, so the probability of false detection at the 
output of the correlation detector is also extremely low. 
[0057] If the position of the watermark pattern in the image 

or video frame is known, it is only necessary to compute the 
output of the correlation detector once, for that position. If 
the pattern has been shifted, then a single instance of the 
correlation detector, operating at one assumed position, will not 
find the pattern. Because the watermark pattern has been chosen 
to be pseudo- random, it exhibits no symmetries under spatial 
shifts (or, at least, the chance of such symmetries will be 
extremely low) . 

[0058] To detect the watermark pattern at an arbitrary 

position in an image frame, the entire image could be filtered 
with the kernel of the correlation detector, and attempt to 
detect the pattern at every pixel position in the frame. As the 
watermark pattern is complex, and the frame may be large, a naive 
implementation of this would be extremely slow. Nevertheless, 
the idea is practical because the filtering can be done very fast 
with fast filtering methods based on fast Fourier transforms. 
[0059] It would be advantageous to map the images, video 

frames, and/or watermark patterns to a special domain in which 
this computation is not required. Also, it would be convenient 
if the search for a pattern over ranges of rotation and resizing 
appeared like the search for a watermark pattern with arbitrary 
spatial position, as described above. 

[0060] The preferred domain is the log-polar coordinate 

system. It is a modification of the polar coordinate system. In 
polar coordinates, a point is represented by its distance R from 
a fixed central point and an angle 0 representing the direction 
of the vector from the central point to the point in question. 
Usually, the angle is measured between the vector and a 
horizontal vector pointing to the right. In the log-polar 
coordinate system, R is replaced by its logarithm, L = log R. 
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Note that in both coordinate systems, the angle 0 dimension is 
periodic, with period 2tt or 360 degrees. 

[0061] Consider a point in Cartesian coordinates (x, y) , where 

x and y are its horizontal and vertical offsets from a reference 
point or origin. Its polar representation can be computed as: 
[0062] R = sqrt (x 2 + y 2 ) , where G = arctan(y/x) 

[0063] This is then converted to log-polar coordinates by 
replacing R with L = log R, as mentioned above. 
[0064] In Cartesian coordinates, given a point (x, y) : 

[0065] Rotation by alpha: (xl, yl) = (x cos alpha - y sin 
alpha , x sin alpha + y cos alpha) 
[0066] Resizing by c: (xl, yl) = (cx, cy) 

[0067] Clearly, a rotation requires trigonometric functions, 

and neither operation is a shift. 
[0068] In polar coordinates, (R, 9) : 

[0069] Rotation by alpha: (Rl, 9) = (R, 6 + alpha) 
[0070] Resizing by c: (Rl, 9) = (cR, 9) 

[0071] Now the rotation becomes a shift, but resizing is still 
a multiplication. Since multiplication is equivalent to addition 
of logarithms, we need only convert R to L = log R to convert 
resizing to a shift. Therefore, in log-polar coordinates: 
[0072] Rotation by alpha: (LI, 91) = (L, 9 + alpha) 
[0073] Resizing by c: (LI, 61) = (log c + L, 9) 

[0074] Finally, in log-polar coordinates, resizing becomes a 

shift by the logarithm of the resizing factor, and any 
combination of resizing and rotation will become a 2 -dimensional 
shift. Remember that the angle coordinate wraps around with 
period 2n. 

[0075] It follows that, if an image or video frame, embedded 

with the watermark 10, and the central watermark pattern 12 is 
converted into log-polar coordinates, the central pattern 12 can 
be found in the frame by implementing a correlation detector that 
ranges over all 2D shifts in the log-polar domain. 

[0076] In a digital implementation, the log-polar coordinate 

space is discrete, with some minimum resolution in each 
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coordinate. The angle coordinate need only have a range of 2n, 
and the L = logR coordinates is limited by the expected range of 
resizing factors and the sizes of the image/video frame and or 
the original size of the central pattern 12. While the 
conversion from Cartesian to log-polar coordinates is a complex 
non-linear resampling, the implementation can be simplified by 
pre- computing and storing the parameters for the re- sampling 
computation. Furthermore, this mapping is only performed once 
for each watermarked frame, and the log-polar representation of 
the central pattern 12 can be precalculated and stored. 

[0077] Then, for the correlation filtering/detection in the 
log-polar domain, the same fast algorithms can be used based on 
fast fourier transforms that were mentioned above (note that a 2D 
Fourier transform operating on log-polar data is sometimes called 
a Mellin transform) . The correlation detection will find the 
best-match position of the central watermark 12, from which we 
can compute the resizing factor and rotation angle. 

[0078] The information from the log-polar coordinates of the 
first portion 12 would be used as discussed above to determine 
any deviation from reference geometric configuration information 

(also in log-polar coordinates within memory of the player) so 
that the hidden message of the second portion 14 of the watermark 
10 can be readily detected and read. 

[0079] The present invention also relates to methods of 
creating a watermark and detecting the watermark on computer 
readable memory media. In accordance with a preferred algorithm 
for detecting a watermark, a circular area within the central 
portion of a video frame 18 is selected. This circular area 
includes the location of the first portion 12 of the watermark 10 
at the center of an associated video frame 18. In the event that 
the video frame 18 has been subjected to resizing or rotation, 
prior art watermarks would not be able to be detected as 
discussed above because the position and/or size of the 
correlation kernel 32 will not match what is expected by the 
correlation detector of the player. Such an arrangement is 
illustrated in Fig. 3, where the watermark 30 and its correlation 


17 


# # 

kernel 32 have been rotated along with video frame 38. In the 
present method, because the first portion 12 of the present 
watermark 10 is arranged in the center of the associated video 
frame 18, the correlation detector of an associated player will 
always be able to find the general location of the first portion 
12. The use of Mellin transforms and log-polar coordinates will 
then enable an associated correlation detector to register with 
the pattern of the first portion 12 and process the image 
thereof. 

[0080] The radius of the selected circular area should be 

sufficiently enlarged to include the central log-polar pattern, 
even if the pattern is resized up to some maximum value. The 
extent of the central log-polar pattern of the first portion 12 
of the watermark 10 should be selected according to the likely 
maximum resizing factor to be selected by the system designer. 
The preselected pattern of the first portion 12 of the watermark 
should then be converted to be recognized in log-polar 
coordinates . 

[0081] Reference information about the geometric configuration 
of the first portion 12 of the watermark is stored in the memory 
associated with the correlation detector of a player as discussed 
above. This reference geometric configuration information is 
preferably stored in log-polar coordinate information. The 
stored log-polar reference information is then correlated with 
the actual geometric configuration information that has also been 
converted to log-polar coordinates. All possible shifts are 
considered. The correlation between actual and stored log-polar 
coordinates is a known technique. There are various ways to 
accomplish such correlation with or related to fast Fourier 
transforms. After the mathematical calculation relating to 
correlation of the stored and actual log-polar coordinates has 
been completed, the maximum output value should be determined 
along with its location. Such location will have two 

coordinates — one "angle" coordinate and "logarithm of radius" 
coordinate. This is the location where the stored central 
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pattern best matches the corresponding patterns in the log-polar 
converted image area. 

[0082] Such information relates to the deviation between the 
actual and stored log-polar coordinate information of the central 
portion 12 of the watermark 10. 

[0083] Given the foregoing information, and the known 
reference size and orientation angle of the stored reference 
information, simple arithmetic can be used to compute the 
resizing factor and rotation angle that the data within the video 
frame 18 has undergone. This information is then used by the 
associated correlation detector of a player to detect and read 
the hidden message carried by the second portion 14 of the 
watermark 10 . 

[0084] The watermark 10 is preferably substantially hidden 
from view when the video data is displayed on an associated 
display screen. This will ensure that the watermark 10 does not 
interfere with the enjoyment of the movie or other video data. 
Although the present invention has been described herein with 
reference to video data, it should be appreciated that the 
present two part watermark and method of detecting an embedding 
scene may be utilized for various other applications, such as for 
use in audio, still image, text or other data. 

[0085] The present invention is advantageous in that it 
provides a low cost solution to protect content on computer 
readable memory media from copying by pirates. The present 
invention is intended to be implemented with existing MPEG 
standards, but it should be understood that it can be modified 
for use with any image/video format or codec. The present 
invention can be used as a detection system in both analog and 
digital domains, and is effective in preventing copying of 
content on memory media from both consumer and professional 
equipment. For example, in order to detect the present 

watermark, one or more frames are typically converted into 
digital form and are then digitally processed. The associated 
correlation detector can then be used to control the analog 
output . 
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[0086] While the foregoing detailed description describes a 
preferred product and methods of detecting and embedding a 
watermark on a memory medium, it should be appreciated that the 
invention is defined by the claims set forth below and is not 
intended to be limited to the preferred embodiments. 
Accordingly, those skilled in the art are encouraged to modify 
the preferred features and steps described herein while remaining 
with the scope of the present invention. 

[0087] Although the invention herein has been described with 

reference to particular embodiments, it is to be understood that 
these embodiments are merely illustrative of the principles and 
applications of the present invention. It is therefore to be 
understood that numerous modifications may be made to the 
illustrative embodiments and that other arrangements may be 
devised without departing from the spirit and scope of the 
present invention as defined by the appended claims. 
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